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ABSTRACT 

From the ideas well set forth by Ferguson, Messick 
and others, a method was sought that would identify different 
abilities that entered at different stages in a task. The method 
selected should meet Cronbach's criterion that it would consider 
individual differences as well as group performance. Tucker's (I960, 
1966) method seemad to be able to identify differing abilities while 
at the same time preserve individual differences. Using Kaiser's 
Little Jiffy Mark IV to skirt the problem of difficulty f actors^ a 
factor of two film tests found two factors operating in each test. 
Had the task been longer (some authors recommended 1000 items) more 
factors might have been found; it is equally likely, however, that 
diminishing returns would soon obtain. It was demonstrated that 
Tucker's method revealed abilities that a conventional learning curve 
would maskj and learning curves of several different individuals were 
illustrated. Some attempt was made to describe the obtained factors 
with other variables; at least one factor correlated with a variable 
similar to Gestalt completion or serial integration. Finally the 
effect of three stimulus characteristics upon item preference was 
considered. Test part (number of stimulus frames, or number of delay 
frames) rarely accounted for an important part of item preference, 
whereas position in the array always did and color did in the two 
color tests. (Author/MLP) 
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In his 1957 APA presidential address » Cronbach pointed out that some in- 
vestigators were concerned with ^roup performance, whereas ether investifjators 
preferred to search for individual differences or selected aspects of behavior. 
The present report seekc to determine both i>roup measures and individual dif- 
ferences in performance on film tests by usinn a factor analytic method proposed 
by Tucker {I960: 1966) • Tucker ^s method produces results reminiscent of 
Fleishman's studies (1967) of the relationship between abilities and performance 
in successive stages in learning. Thus this report fits into the category of 
studies inventoried by Messick (1972) ^ who ur^,ed the development of sequential 
models of psychological processes. 

The history of film tests of cine-psychoraetry has been reviewed elsex/here 
and need not be repeated here. (See Seibert and Snow, 1965; Seibert, i971a» 
1971b.) It will suffice to say that film tests have measured unique and stable 
abilities such as serial integration and time and motion translation, that are 
not measurable ulth paper-and-pencil tests* FUra tests have been developed for 
air force trainees (Gibson, 1947), college students (Seibert and Snow, 1965^ 
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Seibert, Reid and Snow^ 1967), and for normal and dyslexic school childreu 
(IIcDaniel, 1971, 1973). The four film tests used in this study were Short 
Term Visuiil Memory II and III (abbraviatod STVll II and STVTl III) and Shoru 
Term Color Memory I and II (abbreviated STCM I and STCIl II). These four 
f il>r. tests are described in appendix A. The tests resexibled transfer to cr- 
l«2arninf; to learninT task since not all stimuli uere identical. It was assumed 
that subjects scores \Tould inprove somewhat over items, and that Fer<>uson's (1954) 
suf?,?^estion that different abilities exert different effects at different stages 
of la;=irnin<;', ^rould be demonstrated. 

Tucker's (I960, 196G) method appeared to be a protoiolng solution to the 
problem of neasurincr the different traits used at various stap.es in a task that 
at the sane time preserved individual differences. His method Involves the 
factoring; of a trials by subjects data matrix. If the task perfomcd is simple, 
only one factor ni^ht appear, whereas the performance of more challen.'^ins (more 
complex) task might require three or four factors to explain the variance adequately. 

Tucker's method is bfsed on the factor analytic equation 

^ji ^jl ^li ^.12 ^21 ^ 

where x.. is the score on trial j for individual i, the a's are coefficients 
depending on trials^ and the y's are individual paraneters. The a's are con-- 
stant for all subjects on any given trial-, \7hereaa the y's vary across individuals 
on any ^iven trial. The a's can thus be thoup.ht of as a matrix of factor loadincjs 
and the y's a natrix of factor scores. 

Thus, Tucker ^s method indicates the complexity of a task by the number of 
factors required. Second, Tucker's method also indicates hoT? individuals differ 
on the abilities beinj^ used at different staples in the task* If a subject receives 
a high factor score on the first factor and near zero scores on other factors, he 
may be said to be a pure exemplar of Factor I. In contrast, subjects ^tith signify 
icant factor scores on all factors def inin.^ a given trial have more complex methods 
of cognition. Thuc> factor scores indicate hon one individual's learninf; differs 
from another * s* 
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Procedure 

The four filp. testfs mentioned above were administered to 15P college stu- 
dents. After each stinulus itcn, subjects were asked to indicate the letter ^ 
or the color, or the correct position of the stimulus in the array depending; 
upon t;hich test uas bein? viewed. K-P. 20 reliabilities for STCM I and II and 
STP\ II and III were .69, .31 and -90. For this paper, the reportinr: of 

Tucker's Qethod uill bo linitcd to STV?t II part 1 and STV^l III part 1. In SVPi II - 
1 a circle narker designating th3 position precedes the array by 52 r\illiseconds; 
in ST\P{ III 1 not only does the circle marker precede the array but also a bar 
TTiarker appears at the position with the array- Factor analyse? of the 159 x 3 
binary matrices vrere first done usin^ Kaiser's Little Jiffy -Tark IV (1970: Kaiser 
and Ricey 1973) primarily for two reasons- Kaiser's niethod possibly obviates the 
concern vrlth artifactual difficulty factorS;, and it nas desired to ccmpare his 
relatively new technique vith more farniliar techniques. Factor scores veve obtained, 
and factor loadinss and factor scores of selected individuals were plotted. 

To further define the obtained factors, and to characterize individuals re- 
ceivinj> high or Ion factor scores, regression analyses TOre run usinf> a series of 
other independent variables that had been adninistered to the 159 subjects at the 
sarae tine of these film tests. 

Finally, to detemine the effects of varying stimuli characteristics, rep.resoion 
analyses were run for STCH I and II and STV?^ II and III item preferences, usinR 
part score location, and nane of stimulus as independent variables. 

Results 

A Little Jiffy Ilark IV on SVfA 11 - 1 resulted in an overall root mean snuare 
of .lA, a measure of sampling adequacy (MSA) of ,61, and an index of factorial 
simplicity (IFS) of .33. The 1!SA T;ould be characterized as ''mediocre and the IFS 
as "neritorious Table 1 shows the rotated factor solution: 
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Tablo 1 

Little Jiffy Mark IV on STVT! II - 1 
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32 
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31^ 


03 


01 


48 


29* 
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-12 
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-02 


-01 


62 


29* 


-05 


14* 



Factor I mip.ht be described ac late learning, Factor II ao early learning only 
or fatigue and Factor III as beinj; befuddled except at initial and final Gtagcs. 

Figure 1 showc factor loadings plotted for each of the cif>ht items in 
5TVT1 II part 1. Figure 2 shoTjs the conventional learning curve based on item 
preferences. The conventional learning curve completely obscures the fatij^uc 
factor. 

Figures 3 through 6 show leaminj^ curves of four typical subjects with 
different factor scores • Fi^^ure 3 represents the performance of a sublect xTith 
a loT7 factor I score and a uigh factor II score- (Factor scores have been 
rescaied to a raean of 50 and a standard deviation of 10.) The 1ot» score on 
factor I indicates that the -^subject is not a late learner and the high score 
on factor II means that the subject starts out t.^ell, vhich are borne out by 
the ^raph. 7igurc 4 shows the perf ortitmce of subject with low scores on ali 
factors; the graph shorrs that he got none of the items ri^'.ht- Fi'^ure 5 shoijs 
a lea^-ning curve for a subject hir,h on both factors; he got most of t'lc items 
rir^htj as expectecS. Flfjure S shows a iearninp; curve for a subject scorinr, 
hi^h on factor 1 and low on factor *l\ his Icarninf^ curve illustrates his 
description, based on his factor scores, as a late learner > and not one who 
has initial success. 
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A Little Jiffy analysis (a principal conponunts solution followed by 
rotation of all factors associated vjith cARenvaluos of unity or greater) 
on binary data bavins such widely varyinr* itozx preferences as those data 
would produce artif c-ictual difficulty factors. It is probable that the 
Little Jiffy Mark IV does not produce such artif actual factors ^ since the 
analysis io of the iTaar;of;, the predicted value of each Vv-iriablfi from all 
others, and the ina^^es are multivariate noraal. The conservative irord 
''probable ' is used intentionally here since the exact constraints, if any, 
are not yet knoum. This happy trait of the Tlark IV is one of the reasons 
that the llarJc IV vras used as the chief technique for this analysis. 

To gain a further appreciation for the factor n obtained fron the 
application of Tucker's techniqu*^ to STV^^I II > each of the threo factor score 
vectors ▼ras used in turn as the dependent variable in a step^Tise regression 
with 13 other tests that had been administered to the subjects at the sane 
time as STVIl II. These 13 tests are First and Last llanos, Di^it Span 
Visual, Gcstalt Completion ^ ^Jide Ran;e Vocabulary, Advanced Vocabulary, 
Color Forra Recognition, Film Sequence Ilcnory A and B, Picture Identification, 
Successive Perception III and IV ^ and Position Recall II and III. Psycho* 
netricians fainiliat v^ith the French, Ekstrom and Price Kit of Reference Tests 
will rcco«>nizo some of these tests; all are described in Seibert^ Reid and 
Snoxy (1967). Only Picture Identification had a worthwhile correlation (r=.40) 
uith factor scores on factor I. Somewhat similar to a Gestalt completion 
task^ the Picture Identification test is also an important variable in the 
serial intef>ration factor (Seibert, Roid and Snon, 1967). 

Thus subjects who succeeded early in the STVJt II task tended to do so 
by tapping a trait or process '^omex/hat sinilar to serial integration or 
Gsstalt completion; T/hether or not subjects also responde'l correctly to the 
Iteras in the second half of the test depended larj^oly upon whether or not 
they nade use of the trait or process described by factor IT. 

The application cf Little Jiffy :iark IV to STV!I III ~ 1 resulted in an 
overall root nean square of .26, a measure of sampling adequacy of .76, and 
an index of factorial simplicity of .95. The MSA could be described as 
''oiddlinf^ ' and the IPS as ' 'marvelous Table 2 shoves the rotated factor 
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Table 2 

Little Jiffy Ilark IV on STVI III - 1 
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-05 


54* 
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-02 
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40* 
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32 


13 


34 


43* 
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43 


43* 
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52 


45* 
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55 


40* 


-02 



Factor I night be called late learning and Factor II early learning only or 
perhaps fati^u^. 

A Kaiser image analysis (Kaiser ^ 1963; Reid^ 1963) resulted in three 
factors associated with ei^^^envalues of unity or greater: the third factor 
can be tossed. t\ tendency to overf actor is characteristic of this nethod. 
The rotated (varimax) solution is in Table 3- 

Table 3 

Kaiser Inace Analysis on ST\ri III - 1 
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41 
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This is essentially the sane factor pattern as the Little Jiffy Jlark IV 
only lc03 clearly defined. 

A Little Jiffy, probably th^ most coimon factor analysis ' perfomed 
In the literature J resulted in a similar pattern as shoxm in Table 4* 

Table 4 

Little Jiffy on STVt III - 1 





Component 


I ten 


I 


II 


5 


09 


81 


6 


06 


73 


24 


29 


65 


32 


50 


35 


34 


66 


-05 


49 


64 


03 


52 


62 


28 


55 


57 


19 



A naxinum likelihood solution (Joreskog and van Thillo, 1971) solution was 
also applied, and produced sin^ilar results to the other solutions except that 
the factors irerc switched. 

Table 5 

Jorcsko(3's ^laximun Likelihood on STVII III ~ 1 
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Item 
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II 
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99 


08 


6 


39 


24 


24 


40 


39 


32 


17 


49 


34 


12 


39 


43 


07 
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52 


24 


54 


55 


17 


57 
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T7e can be less hesitant about usins Little Jiffy and Joreskog's 
approach with these data fron STVj.I III - 1 sinca iten preferences are more 
nearly homo<r<2neouQ. 

Figure 7 shov;s the factor loadings plotted for each of the Gight iterrcs in 
3TVII III - 1. Figure 3 shows shous the conventional learning curve based on 
item preferences. Wote that the conventional curve tiaskf? the two underlying 
processes. Figures 9 through 12 shoTj learning curves of four typical subjects 
with different factor scores. 

Figure 9 shows the performatice of a subject who is high on factor I and 
low on factor II', accordingly the graph of his performance indicates that he 
nissed the first two iteno and got the remaining six items correct, Flgur'C 11 
shows the performance of a subject som?A7hat the opposite of the subject in 
Figure 9. The subjects in Figure 11 had a low factor I score and a high 
factor II score. 

To get a better understanding of the characteristics of factor I and II, 
each of the two factor score vectors was in turn used in a stepwise regression 
xrith the 13 tests mentioned before as independent variables. Picture Identi- 
fication was again the only test with a tjorthwhilc correlation;; it correlated 
.39 with both factor I and factor II scores. Thus> success in the STVTl III - 1 
test seems to have depended somewhat on an ability similar to serial integration 
or Gestalt completion. 

So far we have applied Tucker's nethod of analyzing learninr; curves by 
factor analysis to two different filn tests to support the idea that different 
abilities exert different effects at different stages of learning. ^Te have 
also attempted to describe these abilities by a set of 13 aptitude tests. 

Finally, we report how the ^,hree specific stimulus characteristics were 
related to iten preference. One stiiaulus characteristic was number of delay 
frames, each set of which defined a part. Although this report has concen- 
trated on one part of ST\rt II and one part of ST\rT III, each test had elG;ht 
parts. A second characteristic was that different letters x/ere randomly 
selected for each item. Third , the correct answer could be in any of 8 
positions in the 2 4 array of letters. 
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Accordingly, rGc>rGSGion analyses v^ere run on iten prefarcnces of ST\ri 
II and III t'lth parts, positions^ md letters as dependent variables to 
neasurc the proportion of variance accountad for by these throe ntinulus 
characteristics. 

A nultiple regression equation irith 26 letter vcctorc^ position vec- 
tors , and 1 part vector^ uith iten oreforencGs of STV?I II as the dependent 

variable produced an = .71^ or R'- = .37. A siuiilar equation but T/itK the 

2 ^2 

part vector dropped ^ave an R = .70, or R = .37. An F test betxreen these 
two nodelG of course molg not significant, Trhich meant that part (that is, 
number of delay frames) played no important role in accounting: for any of the 
varia-\ce in iten preference. 

2 

An equation t,Tith the 2G letter vectors alone ?,avc an of .33 with iten 
preference, but tha unbiased estiMate^ R**, shrunk'to zero. Interestinp, dif- 
ferences occurred in the partial sums of squares anon^, the letters, but this 
discussion can be saved for another tine. 

An equation tTith the 3 position vectors alone ,'»ave an ^ of .50, R ^ .41. 
Thus» position in the array accounted for 41% of the variance of iten preferences. 

A nultiple re<^rGSsion equation ^rith 26 letter vectors, 3 position vectors, 

and 1 part vector, i^ith iten preferences of STVIt III as the dependent variable 

gave an R of .73, or V- = -42. A simlar e'^juation but without the ,)art vector 

r^avG an R of .71v or R = .38. An F ratio between these txTo nodcxs TTas 2.68 

(1, 29) Tfhich is not significant. Thus, as in STV^^! II, part a^ain played no 

important role in accounting for variance of iten preferences. 

0 ■ "2 

An equation uith the 20 letter vectors alone "^^ave an ^. of 42, but R 

shrunk to zero. A regression equation t.jith the 0 position vectors alone 
2 ^2 

produced R = .45 or P. = .37. As in nTV?^ II, position in the array accounted 
for 37% of the iten preference variance. 

It is interestinr> to conpare the influence position has in these two tests 
vrith two other filra tests, Short Tena Color "ieraory (STCM) I and II which used 
a 2 X 3 stimlus array presenting 6 colors from a pool of 9. 

A multiple regression equation vrith 9 color vectors, 6 position vectors, 

and one part vector t;ith iten preference for STCM I as the depend ent vector 
9 ^9 

produced an R = .72^ or R = .61. A similar equation only without the part 
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variable produced an « ,71 or - .61. Thus the variable of part (the 
number of fra^nes the stimulus remains on the screen) had no predictive 
value to iten preference at least in the 4 to 12 franes ranje. 

A model usinp, only the 9 colors as independent variables produced an 
r2 = ,57 or « .48. F (5, 40) 2.50 is significant at the .05 level. Thu3, 
both color and position made sic^nlfxcant contributions to the variance in 
iten preference ±v STCM I. 

A multiple ref^ression equation with 9 color vectors, 6 position vectors, 

and one part vector with item preference for STCM II as the dependent vector 
2 "^2 

resulted in an R *= .73, or H = .63. Vhen the part vector was dropped from 
9 ^2 

the model J the R"^ was .56, or R = .54. The two rerirecsica models produced 
an ratio = 10.86 (df = 1, 39) v/hich is significant at the .01 level, 

\nien the regression model contained the part and color vectors, the 
R^ =» .64, or R^ =» .55. The full model (R^ = .73) conpared with this model 
yielded an F (5, 39) of 2.56, significant at the .05 level. 

I^en the regression model contained both nart sind position vectors, the 
was .16, or = .03. Thus color makes the most contribution to item 
preference variance, but part and position still make some contribution. In 
none of the other three tests in this report did part malce a significant 
contribution to item prrefereace variance. 

Summary 

Frora the Ideas well set forth by Pernuson (1954), Ilessick (1972) and 
others, we sought a riethod that v?ould identify different abilities that 
entered at different stages in a to»k. The tne^rtwl Sieiected should meet 
Cronbach*s (1957) criterion that it would consider individual differences as 
v/ell as group performance. Tucker's (I960., 1966) method seented to be able to 
identify differing abilities while at the same time preserve individual dif- 
ferences. 

Using Kaiser *s (1973) Little Jiffy Hark IV to skirt the problem of dif- 
ficulty factors, ue factor analyzed ttro film tests and found two factors 
operating in each test. Had the task been lon<»er (some authors recommend 
1000 Items) \m likely ni^ht have found more factors; it is equally likely. 
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however, that dirainishinp; returns would soon obtain. 

We demonstrated that Tucker's method revealed abilities that a conven- 
tional learning curve uould raaskj and ^-le illustrated learninf> curves of several 
different individuals. ITe made sone attempt to describe the obtained factors 
x^ith other variables; at least one factor correlated with a variable similar 
to Gestalt completion or serial integration. 

Finally we considered the effect of three stimulus characteristics upon 
item preference. Test part (number of stimulus frames » or aumber of delay 
frames) rarely accounted for an Important part of item preference, whereas 
position in the array always did and color did in the two color tests. 
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Appendix A 



Short Tera Color ilenory I ; S^s are first shoTTO a stimulus pool of nine hexagonal 
color chips (a red, green, purple, yelloi;, oranj^e, brown> gray, pink and blue). 
After these are presented and named, the 54 items of the test then present the 
color chips in a 2 by 3 array, holding the array on the screen either for the 
duration of 4, 8, or 12 frames. There are thus three l8-item subtests, each 
with a different stimulus exposure faration. In each iteiij after the array 
disappears, there are two blank film frames, then an empty hexagonal marker 
appears in oue of the array positions. The Ss are to indicate the color which 
occupied the marked array position. 

Short Term Color Memory II ; This film test is similar to STCM I. It differs 
in that it marks the color to be remembered by follovring the array vrith a 
horizontal colored bar in the center of the screen. The S^s are then to indicate 
the position occupied by the color. 

Short Term Visual Memory II ; A film teot of 64 items which includes eight 
eight-item subtests. In each item an eight letter, 2 by 4 array is presented 
tachistoscopically (i.e., for about 31 milliseconds) in screen center. A 
black circle marker appears to mark one of the eight array positions and S^s 
are to record the letter occupying the designated position. The circle marker 
may precede the array by 52 milliseconds or may follow it by 10, 94$, 177, 260, 
344 J 423, or 510 milliseconds. 

Short Tern Visual Memory III ; This film test is highly similar to STVJI II, 
except that it employs two markers to designate the same array position in 
each test item. Wot only docs a circle marker appear as iu STVII II5 but also 
simultaneously with each 2 by 4 array, a black vertical bar marker appears. 
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